A Unified Learning Scheme: Bayesian-Kullback Ying-Yang Machines
نویسنده
چکیده
A Bayesian-Kullback learning scheme, called Ying-Yang Machine, is proposed based on the two complement but equivalent Bayesian representations for joint density and their Kullback divergence. Not only the scheme unifies existing major supervised and unsupervised learnings, including the classical maximum likelihood or least square learning, the maximum information preservation, the EM & em algorithm and information geometry, the recent popular Helmholtz machine, as well as other learning methods with new variants and new results; but also the scheme provides a number of new learning models.
منابع مشابه
New Advances on Bayesian Ying-Yang Learning System With Kullback and Non-Kullback Separation Functionals
In this paper we extend Bayesian Kullback YING YANG BKYY learning into a much broader Bayesian Ying Yang BYY learning System via using di erent sep aration functionals instead of using only Kullback Diver gence and elaborate the power of BYY learning as a gen eral learning theory for parameter learning scale selection structure evaluation regularization and sampling design with its relations to...
متن کامل22. Bayesian Ying Yang Learning (I): A Unified Perspective for Statistical Modeling
Major dependence structure mining tasks are overviewed from a general statistical learning perspective. Bayesian Ying Yang (BYY) harmony learning has been introduced as a unified framework for mining these dependence structures, with new mechanisms for model selection and regularization on a finite size of samples. Main results are summarized and bibliographic remarks are made. Two typical appr...
متن کاملBayesian Ying - Yang system , best harmony learning , and five action circling
Firstly proposed in 1995 and systematically developed in the past decade, Bayesian YingYang learning is a statistical approach for a two pathway featured intelligent system via two complementary Bayesian representations of a joint distribution on the external observation X and its inner representation R, which can be understood from a perspective of the ancient Ying-Yang philosophy. We have q(X...
متن کامل23. Bayesian Ying Yang Learning (II): A New Mechanism for Model Selection and Regularization
Efforts toward a key challenge of statistical learning, namely making learning on a finite size of samples with model selection ability, have been discussed in two typical streams. Bayesian Ying Yang (BYY) harmony learning provides a promising tool for solving this key challenge, with new mechanisms for model selection and regularization. Moreover, not only the BYY harmony learning is further j...
متن کاملOn essential topics of BYY harmony learning: Current status, challenging issues, and gene analysis applications
As a supplementary of [Xu L. Front. Electr. Electron. Eng. China, 2010, 5(3): 281–328], this paper outlines current status of efforts made on Bayesian YingYang (BYY) harmony learning, plus gene analysis applications. At the beginning, a bird’s-eye view is provided via Gaussian mixture in comparison with typical learning algorithms and model selection criteria. Particularly, semi-supervised lear...
متن کامل